Dimitra Anastasiou Survey on Speech , Machine Translation and Gestures in Ambient Assisted Living
نویسنده
چکیده
In this paper we provide the state-of-the-art of existing proprietary and free and open source software (FOSS) automatic speech recognition (ASR), speech synthesizers, and Machine Translation (MT) tools. We also focus on the need for multimodal communication including gestures, furnishing some examples of 3D gesture recognition software. Our current experiment is based on interoperability between FOSS ASR, MT, and text-to-speech applications, while future experiments will include gesture recognition tools. Our application environment is an ambient assisted living lab at the University of Bremen, suitable for the elderly and/or people with impairments. In a nutshell, our goal is to provide a single uniform multimodal interface combining FOSS speech processing, MT, and gesture recognition tools for people in need.
منابع مشابه
Gestures in Assisted Living Environments
This paper is concerned with multimodal assisted living environments. The research of ambient assisted living is to provide a safe, healthy, and independent lifestyle at a domestic environment. We refer to spatial gestures and gesture recognition software and present our contribution related to gestures in the Bremen Ambient Assisted Living Lab, a 60m apartment suitable for the elderly and peop...
متن کاملSpeech and Gesture Interaction in an Ambient Assisted Living Lab
In this paper we describe our recent and future research on multimodal interaction in an Ambient Assisted Living Lab. Our work combines two interaction modes, speech and gesture, for multiple device control in Ambient Assisted Living environments. We conducted a user study concerning multimodal interaction between participants and an intelligent wheelchair in a smart home environment. Important...
متن کاملMulti-lingual and -modal Applications in the Semantic Web: the example of Ambient Assisted Living
Applications of the Semantic Web (SW) are often related only to written text, neglecting other interaction modalities and a large portion of multimedia content that is available on the Web today. Processing and analysis of speech, hand and body gestures, gaze, and haptics have been the focus of research in human-human interactions and have started to gain ground in human-computer interaction in...
متن کاملA Speech and Gesture Spatial Corpus in Assisted Living
Ambient Assisted Living (AAL) is the name for a European technology and innovation funding programme. AAL research field is about intelligent assistant systems for a healthier and safer life in the preferred living environments through the use of Information and Communication Technologies (ICT). We focus specifically on speech and gesture interaction which can enhance the quality of lifestyle o...
متن کامل